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(b) that the provisional / complete specification relating to this invention is 
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Mayur Vihar Phase - /, Delhi -1 10 091, India. 
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I/we state that the application is divided out of my/our application, the particulars 
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THE PATENTS ACT, 1970 3'i OCT 2C02 



COMPLETE SPECIFICATION 



[See Section 10] 



'METHOD AND APPARATUS TO REDUCE ACCESS TIME IN SYNCHRONOUS 
FIFOS WITH ZERO LATENCY OVERHEAD' 



STMicroelectronics Pvt Ltd., Plot No. 2 & 3, Sector 16A, Institutional Area, Noida - 201 
301, Uttar Pradesh, India, an Indian Company 



The following specification particularly describes and ascertains the nature of this invention 
and the manner in which it is to be performed. 
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METHOD AND APPARATUS TO REDUCE ACCESS TIME IN SYNCHRONOUS 
FIFOS WITH ZERO LATENCY OVERHEAD 

Field of the Invention 

The invention relates to First In First Out (FIFO) memory circuits and more particularly to 
proving a method and apparatus for reducing access time in FIFOs with zero latency 
overhead. 

Background of the invention 

Many electronic designs incorporate First In First Out (FIFO) memory circuits as high-speed 
data buffers. In the majority of the^e applications the access time and latency of the FIFO are 
cntical to the operation of the application. For this reason, it is desirable to have FIFOs that 
provide minimum latency and access time. 

US Patent 5,388,074 describes a FIFO memory using a single output register. Although the 
method and apparatus put forth in the patent specification is simple, it has the disadvantage of 
introducing a latency of one read cycle during memory access. This latency is not acceptable 
in applications that are latency-critical. 

US Patent 6067267 describes a four-way interleaved FIFO architecture with look-ahead * 
conditional decoder for PCI applications. The invention suffers from the drawback that the 
arrangement of registers in the memory banks as proposed by it is more suitable to a 
particular type of application, for example PCI. The architecture is not scalable to other kind 
of memory architectures. 

Objects and summary of the Invention 

The object of this invention is to obviate the above drawbacks in the prior art and provide a 
method and apparatus for reducing access time in FIFOs without introducing any latency 
overhead 

Another object of the invention is to provide a method and apparatus for reducing access time 
without latency overhead that is extendable to existing memories without significant 
modification in the basic architecture of the memories. 
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Yet another object of the invention is to provide a method and apparatus for reducing 
memory access time that is portable to different technologies. 

To achieve these and other objects, the invention provides method and apparatus to reduce 
access time in synchronous FIFOs with zero latency overheads. The improved FIFO buffer 
comprises FIFO means capable of storing fc n' data words, each c m' bits wide, having an c m' 
bit wide data input terminal. The FIFO means have two sets of data output terminals each 
providing simultaneous access to half the number of storage locations, one set connected to 
the storage locations at odd addresses and the other connected to storage locations at even 
addresses. The output of the FIFO means is connected to a data selection means. The data 
selection means selects two data outputs corresponding to the value of the addresses on its 
selection buses. Odd read pointer generating means provides address to one selection bus, 
while even read pointer generation means provides address to other selection bus. The two 
outputs of data selection means are coupled to a multiplexing means. A state controlling 
means controls the output of the multiplexing means. These means also controls odd read 
pointer means and even read pointer means. 



Brief description of the accompanying drawings 

The objects and advantages of the invention will become more apparent with reference to the 
following description and accompanying drawings, wherein: 

Figure 1 shows a conventional circuit arrangement of FIFO memory using single output 
register. 

Figure 2 shows a conventional circuit arrangement of four-way interleaved FIFO 
architecture with look-ahead conditional decoder for PCI applications. 

Figure 3 shows the circuit arrangement as provided by the present invention. 

Figure 4 shows a timing diagram illustrating the operation of the present invention. 



Detailed description of the Invention 

Figure 1 shows a conventional circuit arrangement of FIFO memory using a single output 
register as described in patent US 5,388,074. The system consists of a memory latch array 
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101, a write pointer logic circu,, 103, , read ^ , jc • 
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Figure 2 shows a conventional circuit arrangement f>777 

, • arrangement tor a four- way interleaved prpo 

archttecture with look-ahead conditional decoder thr nrv , mterleaved » 

patent 6 067 M Tt u appl.cat.ona as described in US - 

paten, 6,067,267. The archttecture cnnaisB of four subarrays ^ of J2 

banks BankO 201, Bank! 202, Bank2 203 and Banks 204 Th, h 

204 whirl, i„i a n ° subarray comprising Bank3 

204 wtach tnchtdes regtsters 3,7,1 .,,5 and Bank! 202 which includes registers , 5 0 ,3 is 

2A.0.14 and BankO 20, which indudes registers 0,4,8,12 is called the "Even subl^ 
The output of each of these subarrays is connect ,„ . ■ , Y 

words BanH ina , connected to an tndepende.lt 4: 1 multiplexer. In ofter 

2T« andTr^ " '° ^ B " ,K 2W ,0 MUX2 2 »- B-M 20, to Mux3 

2,0 and BankO 20, to Mux, 209, The output of M„x4 2,2 and M„x3 2,0 is further 
connected to a 2:, multiplexer Muxo 2,3, whale me output of Mux2 2„ and MuT, ^ 
connected to M„x6 2,4. FinaHy the ourput of Muxo 2,3 and M„x6 2,4 is J^Z 
another 2:1 mu,„p,exer Mux7 2,5 whose output , s te finaI ^ out A ^ ^ 
curten, pomter CURT 2,2 (a 4 hi, binary counter with Trdylrdy, as com,, enabl 
me iocanon «o be read. „ is iniuany sc. to "0000" At a Cock edge when Trdybdy goes *gh 
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the 32-bit data corresponding to register 0 is supplied as data out. As long as the Trdylrdy is 
high, CURP increments at each clock edge. 

Each bank read pointer BORP 205, B1RP 206, B2RP 207, B3RP 208 increments to the next 
four registers of its associated bank, once every four clock cycles. Each bank read pointer 
BORP 205, B1RP 206, B2RP 207, B3RP 208 increments at one value of the two-bit 
combination Q1Q0. For example, the incrementing of the two bit bank "0" read pointer BORP 
205 is triggered by a signal from "PLS" generator when QIQ0 = "01" that of the bank "1" 
read pointer B1RP 206 at Q1Q0 = "10", bank "2" read pointer B2RP 207 at Q1Q0 = "1 1" 
and bank "3" read pointer B3RP 208 at Q1Q0 = "00". The flip-flop output "F" is the Q0 
output shown in Fig 4A and is controlled by the Trdylrdy signal. "F" or "Q0", is high 
whenever any of the AND gates triggers a PLS generator to supply a signal to its associated 
bank read pointer 205, 206, 207, 208 to increment, when the decoder is also enabled to 
supply its output. The flip-flop output "F' is part of external circuitry connected to the FIFO. 

A two-bit bank read pointer selects (through Mux4 212, Mux3 210, Mux2 211, Muxl 209) 
which register of each bank is to be read Bank 0 read pointer BORP 205, first selects one of 
the four 32-bit registers of BankO 201, for example, register 0, Similarly B1RP_206_ first 
selects register 1 of Bankl 202, B2RP 207 first selects register 2 of Bank2 203 and B3RP 208 
first selects register 3 of Bank3 204. Each of the four bank read pointers increment after 4 
clock cycles, and points to the next register in its bank. Therefore data is held for 4 clock 
cycles at the output of each bank. 

Figure 3 shows the circuit arrangement as provided by the present invention.to overcome the 
disadvantages of the aforementioned conventional circuit arrangements. The system provided 
by the invention consists of a FIFO 301, which comprises an array of memory elements 'm' 
bits wide and 'n' bits deep. The 4 m' bit wide data to be written into the FIFO is available on 
the "Data In' bus. The write address bus points to the location in the FIFO into which the data 
is to be written. The write pointer circuit 302 generates the write address that is put on the 
Write address bus. The write address bus is c k' bits wide, such that n=2 k The contents of the 
'Data In' bus are transferred into the FIFO element whose address is specified by the write 
address bus, when the write enable is at logic 6 V and a rising edge occurs on the write clock. 
The write pointer is reset by setting the write address bus to zero when the write reset signal 
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« active. The contents of the adchess bus are • 
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Contror p,„ from ^ FSM 307 octrois 'MUX' 30, The eontonts of 

Data Out are asstgned to "Data out" when the "Data out control" is a, Ionic • 1 • -Odd p Z 
Even Read Address buses respectively. The -Odd Read Pointer' 304 counts Ore odd 

2*Z7Z aK 7 m "° X01 " «» ™ ^ Address- bus when Ote "read 

Z IT T ^ ° f ^ "» Addre -" « to "Odd - 

and ^ is a rising edge ou read cloclt. The 
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^ £lft cir r 305 forc * 0x00 ° n - - >- — " - 

»-■«-> - activated. The contents of the -next read address' bus are assigned to 'Even 
«■ address by the even read Potnter 305 ctietut, otny when read reset is Live 2 
T and rising edge on read Co* The tTO1 c „ nteIt5 of ^ - Even ^ 
address' are no, changed when even pointer update is a, logic 0'. 

The ^Current read pointer circuit 308 generates cunen, .eao ^ of ^ FIFQ from 

th da* is acoessed. The cun-ent read address is provtded to the FIFO status circut, 309 a,„„g 

wtth the wnto address bus to generate FIFO status signals like «. enrpty, half e cte 
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current read address is also provided to adder 307. Adder 307 generates the next read address 
by incrementing the contents of the current read address bus and outputs it on the c next read 
address' bus. The contents of the 'current read address' bus are forced to 0x00 by the current 
read pointer circuit 308 when read reset is active. The next read address is generated when 
Read reset is inactive, read enable is at logic ' 1 ' and there is a rising edge on the read clock 

The read process is coordinated by the Finite state machine TSM' 310. The FSM 310 has 
two states viz., Odd and Even. When the Read reset is active, the FSM goes to c Even' state. It 
toggles the state when Read reset is inactive, read enable is high and a rising edge occurs on 
the Read clock. The 'Data Out ControP is at logic 4 0' when the FSM is in even state, while it 
is at logic ' 1 ' when FSM is in odd state. The Even pointer Update is at logic c 1 ' when FSM is 
in Even state and Read enable at logic 6 1\ The odd pointer update is at logic ' 1 ' when FSM is 
in Odd state and read enable at logic 6 1 ' 

Figure 4 shows a timing diagram illustrating the operation of the present invention. Initially, 
the read reset is inactivated at time TO. The initializations would have already taken place. 
The contents of different buses at time TO are as follows. 

• Current read addressjo 0x00 

• State machine to Even state 

• Even read address "to 0x00 

• Odd read address to 0x0 1 

• Next pointer = 0x02 (current read address +2) 

• Data out control to 'O 5 

• Even data out is data contained in the FIFO element DO 

• Odd data out is data contained in the FIFO element Dl 

• Read data out contains data DO. 

At time Tl 

The read enable goes to logic 4 1\ the 'Even pointer update' signal also goes to logic 4 1\ The 
contents of the buses are not updated since there is no rising read clock edge. 
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At time T2 • 

A rising read clock edge is present when read enable is at .ogic < P The contents 

buses are changed as follows contents of different 

• Current read address to 0x0 1 

• State machine to Odd state 

• Even read address to 0x02 

• Odd read address remains unchanged at 0x01 

• Next pointer = 0x03 (current read address +2) 

• Data out control to ' 1' 

• Odd pointer update is at T 

• Even pointer update is at '0'! 

• Even data out is data contained in the FIFO element D2 

• Odd data out remams unchanged and contains the data contained in the FIFO element 

• Read Data out contains data Dl 

In the absence of the current architecture at time T9 f«« • 

pointer is updated (to 0x01) the u^T I T § ^ *» CUrat read 

data element " dB °° dBd ^ "* COntents * the selected ~ 

^ " TIT " " ~ ™ S PrOC6SS ~ - -ss 

^e of the FIFO. The total tnne required for me word ^ - 

decode logic of the address AND -OR l rtm . ■ , required to 

Frpn . oress,A^D OR logic required to force the contents of the selected 

FIFO element on the data out bus and CP to Q delay of the flit, Ann, in * 
tk« ^ y e ril P tlo P s In counter However 

iriT T"'™ by «» — «- *» *. F.FO and ass,gnin 8 „ ,„ te 

o«her da,a o„, bns (Even da* on, or Odd da* on,,, a. contents of ^ „ ^ * ^ 

" • Pr ° P0Sed iS «* » ™* P3T ove, head 

Fnnhermore, smce «he s* tt .naeWne is interned .tag a singTe D- fli p flop fl,e Z, 
« fc w„,d aeeeas ^ fl, cmrent „ only ^ £ 

flop . *a,e n^ p lus ,ne MUX de,a y - whien is si8ni fieann y J ler ^ J*"'' 
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The events occurring at times T3, T4, T5, T6, T7 and T8 represented in the timing diagram 
can be explained similarly. 

The description of the present invention has been presented for purposes of illustration and is 
not intended to be exhaustive or limited to the invention in the form disclosed. Many 
modifications and variations will be apparent to those of ordinary skill in the art. 
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i:™rir dins redu ~ d - * — ■ - 

2** ,:' eCt,OB mea " S ™« » *» -P- —fa* of the FIFO 

rir^r: - ~ ™* — - - » 

odd ™, pomter generatmg means for ^ 
selectton means for feeing data a, an odd read address 

data se.ec«o„ means for se,eehn g data a, an even read address 

means co U p,ed ,„ each of me rwo dara ompm tennma)s of fc 
—on means for se,ec„g one of me onrpnrs of me .ad da. 
selecnon means as the final output of the FIFO and 

a iecnon of ^ HKO 0M pnt and to the odd and even read polar 
generating means. pointer 

An hnproved F.FO buffer m claimed in ^ ^ _ ' 
P^nteanaeonp.ed.oase.ected.adpo.n.er means for generannUo ^ 



means 



An improved HFO buffer as claimed in Cairn 1, further comprising adder 
oupied to the selected read pointer generating means to mcrement the Z address 
for generating the next read address. read address 

2277 m ° ^ " da,med m « - maintaining 

means can have two states namely, odd and even. 8 

An improved method for rerfnrino t u<> 

int™, , g C aCC6SS t,mes of a FI FO buffer without 

mtroducmg any latency overhead, comprising the steps of: 
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providing a FIFO capable of storing 'n' data words, each 'm' bits wide, having 
an 'm' bit wide data input terminal, 

connecting a read data selector to output of the FIFO and providing 
simultaneous access to a selected storage location at an odd address and a 
selected storage location at an even address, 

providing selection inputs to the read data selector for selecting an odd read 
address and an even read address, 

multiplexing the output of the read data selector to enable selection of a desired 
one of the outputs of the read data selector as the final output of the FIFO, and 
controlling the state of the FIFO to select one of the multiplexer output as the 
final output of the FIFO and to control the selection input to the read data 
selector for selecting an odd read address and an even read address. 



6. A method for providing an improved FIFO buffer as claimed in claim 5, further 
comprising generating FIFO status signals. 

7. A method for providing an improved FIFO buffer as claimed in claim 5, further 
comprising generating the next read address by_ incrementing thejniiTent read address. 

8. A method for providing an improved FIFO buffer as claimed in claim 5, wherein said 
state can be odd or even. 

9. An improved FIFO buffer providing reduced access times without introducing any 
latency overhead substantially as herein described with reference to and as illustrated 
in figures 3 & 4 of the accompanying drawings. 

10. An improved method for reducing the access times of a FIFO buffer without 
introducing any latency overhead substantially as herein described with reference to 
and as illustrated in figures 3 & 4 of the accompanying drawings. 



Dated this 3 1 st day of October, 2002 



of AN AND & AN AND, Advocates 

Agents for the Applicants 
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